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Abstract 

Due to their inherent complexity, engineered wireless multihop ad hoc communi- 
cation networks represent a technological challenge. Having no mastering infras- 
tructure the nodes have to selforganize themselves in such a way that for example 
network connectivity, good data traffic performance and robustness are guaranteed. 
In this contribution the focus is on routing & congestion control. First, random 
data traffic along shortest path routes is studied by simulations as well as theo- 
retical modeling. Measures of congestion like end-to-end time delay and relaxation 
times are given. A scaling law of the average time delay with respect to network size 
is revealed and found to depend on the underlying network topology. In the sec- 
ond step, a distributive routing & congestion control is proposed. Each node locally 
propagates its routing cost estimates and information about its congestion state to 
its neighbors, which then update their respective cost estimates. This allows for a 
flexible adaptation of end-to-end routes to the overall congestion state of the net- 
work. Compared to shortest-path routing, the critical network load is significantly 
increased. 
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1 Introduction 



In two previous Papers [1,2] we have already discussed so-called wireless mul- 
tihop ad hoc networks. They represent an engineered communication network, 
which reveals many facets of very intriguing and complex behavior. In this re- 
spect they fit nicely into the cross-disciplinary realm of the Statistical Physics 
of complex networks [3,4,5], which has already opened its doors for other 
communication networks like the Internet, but also for biological and social 
networks. 

Wireless multihop ad hoc networks represent an infrastructureless peer-to- 
peer generalization of todays wireless cellular phone networks. Instead of being 
slaved to a central control authority, each node not only sends or receives pack- 
ets, but also forwards them for others. Consequently, communication packets 
hop via inbetween ad hoc nodes to connect the initial sender to the final recip- 
ient. A lot of coordination amongst the nodes is needed for the overall network 
to perform well. They have to ensure network connectivity, good data-traffic 
performance and robustness against various forms of perturbations, just to 
name but the most important issues. Because of this intrinsic coordination, 
wireless multihop ad hoc networks represent an excellent example of what 
is called a selforganizing network. However, their biggest challenge is yet to 
come, how to get selforganization to work. 

The connectivity issue has already been discussed quite extensively [1,6,7,8,9], 
also addressing interference effects [10,11]. In one form or the other all these 
efforts relate to continuum percolation [12,13,14]. An interesting distributive 
scheme has been put forward in [1], which turned out to be amazingly robust, 
guaranteeing strong network connectivity almost surely; we will briefly touch 
upon this scheme again in Sect. 2.1. - The robustness issue with respect to 
selfish users has received inspirations from the biological immune system and 
distributive algorithmic suggestions have been put forward [15]. 

As to data-traffic performance, estimates on the throughput, i.e. the capacity 
of how much end-to-end traffic the network is able to handle without overload- 
ing, have been given. In [16] a rigorous upper bound has been derived to scale 
with the square root of the network size. Refined estimates have been given in 
[2], revealing that the scalability of the throughput depends on the underlying 
network structure. Besides several other idealistic assumptions, these estimates 
have employed shortest-path routing. Although several proactive and reactive 
routing schemes have already been discussed [17,18,19,20], we are not aware 
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of any selfoptimizing scheme, which also accounts for congestion avoidance. 

In this Paper we will propose a prototype for such a highly wanted distributive 
and adaptive routing & congestion control. The idea is that every node keeps 
an estimate of how much it costs to send packets to final destinations and to 
update these estimates in a distributive manner. The latter can be achieved 
in a very elegant way without any additional exchange of control information. 
Whenever a node is actively involved in a forwarding one-hop transmission, 
it silences its neighbors anyhow, so that those do not interfere on the shared 
wireless propagation medium. This blocking is called medium access control. 
Upon blocking its neighbors, the node is able to distribute its routing cost 
estimates and its congestion state to them, which those then use to update 
their cost estimates. In the technical jargon of engineers, this distributive 
scheme corresponds to a coupling of the medium access control layer with the 
routing layer. 

The structure of this Paper is as follows. Sect. 2 summarizes the key oper- 
ational features of wireless multihop ad hoc networks, introduces plausible 
simplifications and describes the setup of generic simulations with random 
data traffic. Shortest-path routing is used in Sect. 3 to investigate certain fin- 
gerprints of congestion like end-to-end time delay and single-node relaxation 
times. Whenever possible, the numerical simulations are accompanied with 
analytic modeling. Sect. 4 presents the details of the proposed distributive 
routing & congestion control and compares its results to those obtained with 
the shortest-path routing. The conclusion and a short outlook are given in 
Sect. 5. 



2 Some basics on wireless multihop ad hoc networks 



We explain the key features of wireless multihop ad hoc networks hand in 
hand with some simplifications. 



2.1 Geometric ad hoc graphs 



The first simplification is to neglect mobility and to distribute N nodes onto 
the unit square in a random and homogeneous way. Then, according to a 
simple isotropic propagation-receiver model, a unidirectional link from node i 
to node j exists, if 



NOISE + £activ B fc*y#fcj 



> SNR . (1) 
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Pi denotes the transmission power of node % and Rij represents the Euclidean 
distance between % and j. The path- loss exponent a is assumed to be constant. 
Without any loss of generality the variables noise and snr are set equal to 
one. Condition (1) guarantees that j is able to listen to i, i.e. Throughout 
this Paper we will neglect the interference sum over other active nodes k in 
the denominator of (1); this is justified once a is not too close to 2 [11]. 

With these simplifications, wireless communication networks can be modeled 
as graphs Q = (M,C), where M refers to the set of nodes and C to the set 
of links. In general these links in C are directional links % — > j. The subset 
£bidir £- £ represents the complete set of all bidirectional links % «-> j. Al- 
though not strictly required, bidirectional links are preferred for the operation 
of wireless ad hoc networks because many communication protocols require 
instant feedback. The subset Mi C M is called the communication neighbour- 
hood of node % and represents the complete set of nodes j E Mi that all have 
bidirectional links j «-> % in £ bldir with node %. The node degree hi of node % 
is the number of nodes contained in M%. In a similar fashion M° ut defines the 
set of nodes that have at least an unidirectional link % — > j from %. A commu- 
nication route or path is a sequence of nodes such that there are bidirectional 
links in £ bldir between all consecutive pairs of nodes. A shortest path between 
two nodes i, f e M is a route containing fewest possible number of nodes. The 
average length of all shortest paths over all node pairs i, f is refered to as the 
diameter D of the network. 

One further step is needed in order to fully specify wireless multihop ad hoc 
network graphs: assignment of the transmission power Pj for all nodes. Most 
widley used is the constant transmission power rule, where the same trans- 
mission power Pi = P is assigned to all nodes % G M [6,8,16]. All existing 
links are then bidirectional. Once the transmission power is chosen such that 
P = (k taiIgct /irN) a / 2 , an average node will have k taxget bidirectional neighbors. 
This target degree has to be /c target > 4.52 for a connected giant component 
to exist independent of the network size [14], but for the entire network to be 
strongly connected it needs to be larger [1,7,9]. We adopt the value ^target = 24, 
which guarantees strong network connectivity almost surely for network sizes 
up to several thousands [1]. We will call wireless multihop ad hoc network 
graphs generated with this power assignment as const-P networks. 

A different power assignment has been presented in Ref. [1], which is more 
energy efficient. It is based on a distributive assignment. In a nutshell, each 
node % forces the k min closest nodes j to adjust their transmission powers to 
Pj = Rfj, while adopting the value p = sup^ Pj for itself. Its own value can 
be increased further whenever another close-by node forces i in return to have 
an even larger transmission power. In this respect each node has at least k m i n 
bidirectional neighbors. We adopt the value k m i n = 8, which guarantees strong 
network connectivity almost surely for network sizes up to several thousand 
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nodes [1]. We will call wireless multihop ad hoc network graphs generated with 
this heterogeneous power assignment as minimum-node-degree networks. 

Fig. 1 illustrates two random geometric graphs, one obtained with the const- 
P assignment and the other with the minimum-node-degree assignment. We 
explicitely point out that the existence of links in £ is a direct result of the 
spatial positions and the transmission powers of the nodes. In that sense not 
every possible set of links C can be realized by an appropriate power assign- 
ment. This is in clear contrast to any wired network where such restrictions 
do not influence the existence of connections between different nodes. 



2.2 Generic data traffic 

In order to study the statistical properties of data traffic on wireless multihop 
ad hoc networks, the generic simulation model as already presented in Ref. 
[2] has been applied. For the sake of illustration of the key mechanisms, we 
now give again a short outline. The simulation is based on discrete time steps. 
At the very beginning of a time step a new data packet of fixed size can be 
generated at each node i G Af with a probability /ij — /i < 1, which is also 
referred to as the packet creation rate. In case of creation at a certain node i, 
a destination / is randomly chosen among {A/" \ i} and the packet is put at 
the end of i's buffer queue, assumed to have infinite capacity. Nodes, for which 
a new packet has been created, are blocked and are not involved in any fur- 
ther communication action for the remainder of this time step. During a short 
contention phase following the packet creation phase the non-blocked nodes 
with a non-zero queue compete for gaining sender status. A competing node 
% is randomly picked first and obtains permission to transmit its first-in-line 
packet. It then makes a decision, to which neighbor j G Ai the packet with fi- 
nal destination / is forwarded. In its simplest form, this could be shortest-path 
routing or, in a more sophisticated form, routing depending on the congestion 
state. In order to reduce mutual interference within the shared communication 
medium, the sending as well as receiving node block their respective outgo- 
ing neighbors {(A/^ out \ j) U (A/"° ut \ i)} for the remainder of this time step; 
this blocking is called medium access control (mac). Only then another node 
with non-zero queue that has not been blocked so far is chosen at random 
to attempt the transmission of its first-in-line packet. If the intended receiver 
has already been blocked before, the node tests its second-in-line packet and 
so on, until either the first idle recipient is found or the end of its queue is 
reached. This service discipline is denoted as first-in-first-possible-out. If this 
node succeeds to gain sender status, it then MAC-blocks again its remaining 
outgoing neighbors as well as those of the receiving node. This iteration is 
repeated until no free one- hop transmissions are left. Finally, all nodes with 
sending permission then submit their selected packet and remove it from their 
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queue. The receiving nodes either add the incoming packet to the end of their 
queue or, if they are the final recipient, destroy the packet. 



3 Fixed shortest-path routing: properties of data traffic 



A particular simple form of routing uses shortest paths with respect to the hop- 
metric. For the network to learn about the shortest routes all by itself, each 
node is required to flood discovery information into the whole network, collect 
the feedback and store those routes with the shortest hop distance. In prin- 
ciple degeneracy might occur, which would allow to pick the least-congested 
shortest path between initial sender i and final recipient / as a modest form 
of congestion control; we will come back to this in Sect. 4.1. For all of this 
Section we prefer to discard degeneracy, pick one of the shortest degenerate 
paths at random and forward all packets originating in % and destined for 
/ along it. This restriction allows for several analytical insights and points 
to the specific needs for improvement which a more sophisticated routing & 
congestion control has to take care of. 



3.1 End-to-end time delay I: simulation results 



We define the end-to-end (e2e) time delay of a packet to be the number of 
time steps between the generation at the originating node and the destruction 
at the final receiver. Its temporal and network-ensemble average provides a 
measure of the network performance. The direct sampling of end-to-end times 
within the generic data traffic simulations implies a tagging of each packet with 
its creation time and is needed to extract respective distributions. Although 
average e2e-time delays can also be determined via this route, an indirect 
sampling procedure is more efficient in that case. In the subcritical regime 
/-£ < l^crit the average number fiN of packets created within the overall network 
per time step must be equal to the number of packets delivered per unit time. 
Since the average time a packet spends in the network is (t e 2 e ), we can assume 
that (N active ) / (t e 2e) packets are delivered to their final destination per unit 
time, where (N active ) = (X^i) represents the average total number of active 
packets after a stationary network state has been reached. This leads to Little's 
Law, 

{NacUv . e) = fxN , (2) 

\te2e) 

well known in queuing theory [21]. Since the network size N and the packet 
creation rate \i are known to us and (N active ) is easily sampled, Little's Law 
allows for the indirect determination of the average end-to-end time delay. 
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Fig. 2 illustrates the average e2e-time delay as a function of the packet creation 
rate /i. As expected, it increases with the network load /i and diverges at the 
critical packet creation rate /x crit , which is a clear phase-transition-like sign 
that the system is about to leave its uncongested subcritical state and to 
enter its congested supercritical state for /i > /i CT it- We also observe that jj, CT \ t 
is different for the const-P and the minimum-node-degree networks; see Ref. [2] 
for more details on the dependence of the end-to-end throughput fi cr itN on the 
underlying network structure. In the limit fj, — > the average e2e-time delay 
converges to the network diameter (t e2e ) — > D. Although this observation is 
intuitively clear, we will give an analytic support in the next Subsection. Due 
to the differing network diameter, it appears that with respect to e2e-time 
delay the const-P networks perform better than the minimum-node-degree 
networks. Note however, that their respective parameters k target and k min have 
been chosen from the connectivity perspective only. A larger k min would lower 
the network diameter for the minimum-node-degree networks. In Sect. 3.3 we 
will present another form of performance comparison between the two network 
models. 

The distribution p(t e 2e) of the e2e-time delay obtained from the generic data- 
traffic simulation with fixed shortest-path routing is shown in Fig. 3. It is a 
network-wide distribution, which has been sampled over all generated packets. 
The employed const-P network realization consists of N = 100 nodes. Safely 
inside the subcritical phase (// = 0.005) the sampled distribution can be fitted 
well with a generalized exponential 

Pcxponcntial(^c2c) ^6 ^ ^ . (3) 

However, for packet creation rates (/i = 0.0095) close to /i cnt = 0.0101 of the 
particular used network realization a log-normal distribution 

Plognormal(^c2e) 7n = I g ( e2e ) /( ) 

V 27TOT e 2e 

provides a better fit. The emergence of a log- normal distribution close to the 
critical packet creation rate appears to be an inherent feature of communi- 
cation networks [22,23], when nodes are strongly and collectively coupled via 
heavy data traffic. 

The tendency to have a small but non-negligible number of packets with a 
rather high end-to-end time delay is an undesirable feature for communication 
networks. A suppression of this tail in the distribution of the end-to-end time 
delay is regarded as one goal of any advanced routing & congestion control. 
Of course, another goal is to increase the critical packet creation rate. 
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3.2 End-to-end time delay II: analytic estimate 



In this Subsection we give an analytic estimate of the mean end-to-end time 
delay. The starting point is Little's Law (2), which demands to model the 
average number A^ act i V e of active data packets traveling on the network. Upon 
assuming inter-node correlations to be small, we adopt the single-node picture 
and reduce iV active = J2i n i to the modeling of a single-node queue length 
rij. The latter itself depends on the in- and out-flux rates fif 1 and fi° ut of 
data packets to node %. If this turns out to be the only dependence, then the 
probability for node i to have packets in its queue can be described by the 
rate equation 

P (m, t + i) = tiM^ + 1, t) + (1 - /4 n - /i° ut )p(rn, t) + tf P (m -l,t). (5) 

Reducing to the stationary limit p{n^ t+1) — p{n^ t) and taking the boundary 
condition p{rii < 0) = into account, its normalized solution is 



As a direct consequence, the relations 

// in ///? ut 

{ "' } = T^WW (7) 

and 

P(n t > 1) = tf/tf* (8) 
are derived, which will be of later use. 

We have carefully checked the assumption going into (5); see also [24]. If the 
queue length distribution only depends on the in- and out-flux rates, which is 
filed M/M/l in queuing theory [21], then the interarrival and sending 

times statistics should both obey the geometric distribution 

P (£™/send = ^ = ^ _ ^/outy- 1 ^in/out ^ (g) 

which comes with mean ^ rnvc / scnd ^ _ \j ^/ out anc l reflects the independence 
of subsequent packet arrival and departure events. The interarrival time t?- rrive 
is defined as the time between two successive arrivals of data packets that are 
put at the end of node i's queue. The sending time t- end is defined as the time 
between two successive sending events from node i to any of its neighboring 
nodes j G Mi given that the queue is non-empty. Fig. 4 illustrates results 
obtained from the generic data traffic simulation, which show that, when fo- 
cusing on a single node of an arbitrary network realization, the distributions of 
interarrival and sending time nicely follow the parameterization (9) for various 
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packet creation rates and that the extracted in- and out-flux rates lead to a 
good agreement between the queue length distribution (6) and its simulated 
counterpart. 

The modeling is now open for the in- and out-flux rates. We briefly outline the 
results, which have already been derived in a previous Paper [2]. The in-flux 
rate 

K" = ^ do) 

is proportional to the rate fiN of newly created packets, of which the fraction 
B i /N{N — 1) will be routed via node i during later time steps. The node inbe- 
tweeness Bi and, equivalently, the link inbetweeness B^j count the number of 
shortest paths, which go over node i and link respectively. The modeling 
of the out-flux rate /i° ut = l/r^ is equivalent to the modeling of the mean 
sending time n = (tf nd ): 



Ti = l+ E V 3 Mn > 1) + E P»(n» > 1) E %P 
heM™ j2&N(Nl n )\Nl n heN™ h 

- 1 i V ^ Bjl t 4- V ^ Bj2 t V B J2^21 (U\ 

" ^ (N-l) n ^ (N-l) 32 ^ 2B ' 1 ' 

The first sum in the first line represents those one-hop neighbors j±, which 
also want to transmit a packet at the same time. Also two-hop neighbors j 2 
contribute, once they have a packet to transmit to a one-hop neighbor, which 
would then MAC-block node i\ this is described by the last term of the first 
line. For the second step, Eqs. (8) and (10) have been used, leading to N 
coupled linear inhomogeneous equations for the sending times, which are then 
solved numerically for a given network realization. Note, that the expression 
(11) overestimates the actual sending time to some extend, because one- and 
two-hop neighbors might have already been blocked by previously assigned 
one-hop transmissions. 

Upon putting Eqs. (2), (7), (10) and (11) together, an analytic estimate of 
the average end-to-end time delay can finally be given. It is interesting to 
mention two limiting cases. In the limit fi — > of very small packet creation 
rates, the estimated sending times (11) converge to — > 1, so that the average 
end-to-end time delay becomes 

f?,fe.)^» D = "- (12) 

where the sum rule (B^ = (N — 1)D has been used to express the mean node 
inbetweeness in terms of the network diameter [2]. This shows that for weak 
data traffic loads the network diameter determines the end-to-end time delay. 
In the other limit, \i — > fi cr it, the average end-to-end time delay is dominated 
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by the most critical node. This node % is the first, for which the in- and out-flux 
rates become identical and which determines the critical packet creation rate 
fJ'crit — (N — l)/(sup J - BjTj). The sum over all nodes J2j n j ~ n i breaks down 
and we arrive at 



/ v 111 

lim (t e2e ) = — T7 B TT ~ • 13 

In the last step we have made use of the fact that Tj(/i) is bounded from above 
by the magnitude of node €s one- and two-hop neighborhood. As the packet 
creation rate approaches fi C rit, the number of packets within the network ex- 
plodes to infinity. The critical exponent turns out to be 1. 

For the const-P and minimum-node-degree networks, the analytic estimate 
of the average end-to-end time delay is shown in Fig. 2 and compared to the 
respective results obtained from the generic data traffic simulations. Note that 
both the analytic as well as the simulation estimate have been averaged over a 
large sample of network realizations. For // safely below fi crit a good agreement 
is found. Since the analytic estimate and the generic data-traffic simulation 
produce a slightly different fi C rit, divergence of t e2e sets in at different fi, so 
that the quality of the comparison declines for \i close to fi cr u- 



3.3 End-to-end time delay III: scalability 



Instead of comparing the load-dependent end-to-end time delay between the 
two network models of fixed size, a comparison within a given network model, 
but of varying size allows to address the scalability issue. Fig. 5 illustrates {t e2e ) 
as a function of fi>/fi cr it for various sizes N > 100 of const-P and minimum- 
node-degree networks. For each \xj fi cr u and fixed N generic data traffic simula- 
tions have been run with a sample of 100 network realizations. Note also, that 
for each realization the critical packet creation rate fluctuates to some small 
degree. For a fixed n/ncrit the end-to-end time delay increases with network 
size. In the limit // <C /j, cr it this increase roughly scales as \^N, which is in 
accordance with t e 2 e (/i = 0\N) = D(N) ~ VN, reflecting the scaling behavior 
of the network diameter. 

In order to make scalability statements also for < njUcrit < 1> the following 
scaling ansatz is proposed: 

/ t e 2e(n/Vcrit\N) \ ^ = t e2e (fi/ [I crit \N ) 

V t e2e (0\N) ) ~ t e2e (0|iVo) ' 1 ' 

N is some reference network size. An exponent 5 = 1 would imply that the 
relative increase of the end-to-end time delay with respect to relative network 
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load is independent of the network size. For 5 > 1, the relative increase would 
decrease with network size and for 5 < 1 it would be the other way around. In 
fact, the scaling ansatz (14) leads to an excellent curve collapse, also shown 
as the lowest curve in Fig. 5 (top) + (bottom): the solid curve corresponds to 
the right-hand side of (14) with N = 200 and the collapsing symboled curves 
correspond to the left-hand side of (14). The fitted exponent 5 is shown in 
the inset figure and reveals an iV-dependence of the form S(N) = (N/Nq)^. 
For const-P networks with ^target — 24 and minimum-node-degree networks 
with k min = 8 we find (3 = 0.11 and 0.25, respectively. This outcome shows, 
that from the perspective of the relative end-to-end time delay minimum- 
node-degree networks scale better with increasing network size than const-P 
networks. 

Focusing on the size-dependence of the network models, the analytic estimate 
of the average end-to-end time delay also confirms the scaling ansatz (14) with 
S(N) = (N/Nq)^; see insets of Fig. 5 (top) + (bottom). For minimum-node- 
degree networks the found value /3 = 0.25 perfectly matches the outcome from 
the generic data traffic simulations, whereas for const-P networks a small dis- 
crepancy remains between the theoretically found (5 — 0.15 and its simulation 
counterpart 0.11. 



3.4 Single-node Correlation time: simulation results 



Another reason for the emergence of congestion is that the queue length at 
specific nodes may fluctuate strongly around its mean. For sure, the occurrence 
of Hi 3> (rij) with non- negligible probability enhances congestion. More than 
this, it is also the enhanced time it takes in such cases to relax back to the 
mean. A long relaxation time would mean that the specific node as well as 
its surrounding part of the network stay in a congested state for quite some 
time. A straightforward measure of such a relaxation time is given by the first 
moment (n(t + At)\n(t)) of the conditional probability p(n(t + At)\n(t)) to 
have a queue length n(t + At) at time t + At given n(t) packets at time t. It is 
related to the correlation function r(At) by averaging over all possible n(t): 

r(At) = Mt+ ,^ 2 )n(t)) = ^ J>(* + At)\n(t)) n(t) p(n(t)) ■ (15) 

\ n l \ n l n(t) 

Thus, the correlation function can also be seen as an averaged measure of 
relaxation times. 

Fig. 6 illustrates the sampled single- node temporal correlation function rj(At) 
for a characteristic node in a typical const-P network. The convergence of 
rj(At) to 1 for large time differences indicates that correlations between queue 
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lengths Ui(t) and rii(t + At) no longer exist for large At. As the packet creation 
rate grows, this decorrelation is shifted towards larger time differences. 

A non-standard way to extract characteristic time scales results from the ob- 
servation, that the various curves of Fig. 6 for differing packet creation rates 
all appear to have a similar functional form. This motivates the curve collapse 



n(At) 



(16) 



^ -^collapse (aO > 

where the condition rj(At=0) = (nf (£)) / (rii(t)) 2 fixes the exponent to ( = 
ln((nf(t))/(nj(t)) 2 )/ln/(0); for later convenience we choose /(0) = 2. A suit- 
able tuning of T co n apse (ii) then leads to a perfect curve collapse; see the inset of 
Fig. 6. The extracted time scale is shown in Fig. 7 as a function of the packet 
creation rate. - Another, now standard way to extract a characteristic time 
scale uses 

(r(t) 1/C -l)dt= (r(O) 1 ^ - l) T int (17) 

to define an integral time scale T int . Its dependence on the packet creation rate 
is also shown in Fig. 7. 



3.5 Single-node Correlation time: analytic estimate 



We will now give some semi-analytic understanding of the simulation findings 
of the previous Subsection. In the rearranged form, 



p(n,t + l) -p(n,t) 

\p(n + l,t)-p(n-l,t)} 



2 

(a out + u in 

+ ^ \p(n + l,t)-2p(n,t)+p(n-l,t)\ , (IS) 

the rate equation (5) transforms into a Fokker-Planck equation 
dp(n,t) , t N 0p(n,t) {^ ont )dMn,t) 

m ~ ^ J Fln. + 2 fir,? 



(19) 



The invoked continuum limit from discrete to continuous n is justified for 
long queue lengths (n) ^> 1, which is the case when the in- and out-flux 
rates /i m ;U out are almost the same. The latter also determine the drift and 
diffusion coefficients 

,.i n , .out n , ,in , ,,out /"orA 

— 7 = /i —(J, , U = \l +n , (21) J 
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which are both constant. Note, that a minus sign has been introduced in the 
definition of the drift coefficient, which guarantees 7 > for the subcritical 
traffic regime fi m < /i out . 

The solution of this Fokker-Planck equation with given initial condition n(t=0) 
and reflecting boundaries at n = and 00 requires an expansion into eigen- 
functions [25]. The eigenfunction method also allows a direct calculation of the 
correlation function. This calculation is rather lengthy, but straightforward. 
Details are given in Ref. [24]. Here, we state only the final result, 



<n(t)n(0)> = ±g 




— M ( -, — , — t 
16 1 2 2' 2D . 




(21) 



expressed in terms of confluent hypergeometric functions [26]. It comes with 
the property (n 2 (0)) = 2(n(0)) 2 , which is in agreement with the simulation 
results of the previous Subsection for packet creation rates close to the critical 
one (see again Fig. 6), where (n) ^> 1. It also explains the choice /(0) =2 
introduced for the curve collapse (16). 

The expression (21) only depends on the in- and out-flux rates (20), other- 
wise its functional form is fixed. Upon taking the sampled /z- n and fi° ut from 
the generic data traffic simulation, expression (21) can be compared with the 
directly sampled correlation functions; this is done in Fig. 8. For all packet 
creation rates, the decorrelation time obtained via (21) is systematically some- 
what larger than for the directly sampled correlation functions. A possible 
reason for this discrepancy might be the invoked rescaling (r^At)) 1 ^ of the 
latter. However, the functional form looks the same and also the respective 
time scales T co u apse and T int as a function of the packet creation rates show 
a good agreement with the previously obtained results of Fig. 7. The over- 
all good correspondence between the simulation and the semi-analytic results 
more or less explains the increase of the correlation time scales with grow- 
ing packet creation rate as an inherent feature of the underlying single-node 
queuing behavior. 



4 Routing & congestion control 



/,From the previous Section on the generic data traffic with shortest-path 
routing we have learned several things. It is the most critical node, which gets 
overloaded first among all other nodes and which determines the critical packet 
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creation rate of the overall network. This limits the network's e2e-throughput 
capacity to fi cr[t N. Moreover, for network loads close to /i cr it a good fraction of 
nodes belonging to the greater neighborhood of the critical one will also come 
with large queue lengths rij >> 1. This congestion cluster then gives rise to 
large average e2e-time delays and to large fluctuations of the latter, which in 
turn result in large relaxation times. It is the goal of any routing & congestion 
control to avoid such congested network areas and to detour the data traffic 
around. Such actions are likely to be rewarded with an increase of the e2e- 
throughput capacity, a decrease of the average e2e-time delay as well as its 
fluctuations and the related relaxation times. In this Section we discuss three 
different routing & congestion controls of increasing sophistication. The first 
one exploits the degeneracy of shortest e2e-routes. The other two approaches 
modify the distance metric to include each node's congestion state and adapt 
the routing decisions according to updated cost estimates, which are locally 
exchanged with every MAC-blocking. 



4-1 Simple congestion control with degenerated shortest paths 



The shortest-path (SP) routing used in Sect. 3 does not take advantage of the 
route degeneracy between an arbitrary sender and a final receiver. Randomly 
choosing one out of several degenerate shortest routes for each new packet 
will already give some relief to the most congested nodes. However, a bias on 
the actual congestion state would do even better. A simple extension in this 
direction is shortest-path shortest-queue (SPSQ) routing. Instead of randomly 
choosing one next-hop neighbor out of the several degenerate shortest routes 
that specific node is picked which in addition has the shortest queue length in 
its buffer for this very moment. If more than one node qualifies, one of them 
is again picked randomly. Note, that in order to make such a routing deci- 
sion, the forwarding node needs to have information from its neighbors about 
their congestion state. A very elegant way to provide this information with- 
out sending additional control packets is to include it into the MAC-blockings, 
in which the neighbors had been actively involved during previous one-hop 
transmissions. 



As can be seen from Figs. 9, 10 and 11, the simple SPSQ routing & congestion 
control already leads to some noticeable improvements. The critical packet 
creation rate, where the average e2e-time delay diverges, increases. The tail 
of the e2e-time-delay distribution is suppressed to some extend. Last but not 
least, also the correlation time scales have become smaller. 
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4-2 Congestion control with instantaneous adaptive routing 

If a node would have the complete information on the instantaneous congestion 
state of all other nodes belonging to the network, then it could determine the 
shortest route to the intended final recipient with a modified metric, which 
does not only take the hop distance into account, but also counts the queue 
lengths of all inbetween nodes. However, first of all the node does not have 
this information, and even if it would, then the shortest path at decision time 
needs not be equal to the shortest path for delivery due to the always changing 
congestion state of the network during delivery time t e 2 e . Instead, the node 
could try to get some sort of cost estimate it takes to send the packet to the 
final destination via this or that neighbor, and to constantly update these 
estimates. This idea is already known as asynchronous vector distance routing 
[27] and has found its way into Internet routing at the autonomous-system 
level. Next, we give an outline of this approach, modified and tuned to the 
specificity of wireless multihop ad hoc communication. 

Pick a node % that has a packet to forward to the final destination /. Node % has 
to decide to which neighbor j e Mi it is going to forward the packet. For each 
of them it has a cost estimate Wi/j. It chooses node j m m, providing the lowest 
cost estimate Wifj min = min^^/-. Wifj = Wif. Before i starts transmitting 
its packet to j min , it has to MAC-block its neighbors. Hand in hand with the 
blocking signal it tells them about the minimum cost Wif and its future queue 
length rii — 1. While then being blocked, those neighbors have enough time to 
process this information and update their estimated cost 

W . f i <_ Wji + W . f (22) 

to send a packet via i to / during a future time step. Wji is the cost to send a 
packet from j to its neighbor i. Since the queue length ni — 1 is a reasonable 
measure of how busy node % is [27,28], we set 

= fa - 1) + 1 ; (23) 

the one at the end takes care of the hop-distance between the two nodes. As 
the intended receiver of i's to-be-transmitted packet, node j min also blocks its 
neighbors k G Afj . and takes this chance to inform those about its estimated 
cost Wj min f and its future queue length n Jmin + 1. Those neighbors then process 
this information analogous to (22), but with the modification 

*% min = K min + 1) + 1 (24) 

for the future link cost. 

Updating the estimated costs after receipt of an extended MAC-signal appears 
to be a natural thing for wireless multihop ad hoc communication. It couples 
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the MAC-layer and the routing layer in a very elegant way and gives rise 
to a distributive congestion control. Note that beyond MAC no additional 
congestion control signals have to be exchanged. This is in contrast to other 
communication networks like the Internet, which first probe the congestion 
state with additional dedicated signals before they adapt to it. 

A few more technical words are in order. The congestion information dis- 
tributed by the MAC-signals may either include only those cost estimates be- 
longing to the final destination of the currently transmitted packet, or it may 
include much more than this, namely the cost estimates to every single node 
of the network. Both cases certainly represent two extremes, the former fo- 
cusing on keeping the distributed signal small and the latter allowing for a 
faster spread of the congestion information over the entire network. For the 
remainder of this Paper, we will only concentrate on the latter case. 

Implementing the proposed congestion control for the generic data traffic sim- 
ulations, requires to specify the initialization. The initial cost estimates have 
been set to 

i (/ e M) 

W if j = \o (i = f) ■ (25) 

oo (else) 

The simulations themselves then have shown that for not-too-small packet 
creation rates the number of time steps it takes to distribute the initial cost 
estimates over the entire network and to reach a kind of steady state is of the 
order of the network size N. Furthermore, test simulations have revealed that 
a relaxation of the deterministic lowest-cost-neighbor choice for forwarding the 
data packet, such that also the other higher-cost neighbors become eligible in 
some probabilistic form, always leads to a degradation in performance. 

The simulations of the generic data traffic for the routing & congestion control 
with the MAC-distributed lowest-cost estimates (MACLCE) have turned out 
to be quite time-consuming. For this reason we present results only for one 
realization of a constant-P network with size N = 100. The simulation run 
took 5 • 10 5 time steps. As a function of the packet creation rate the average 
e2e-time delay is illustrated in Fig. 9. For moderate packet creation rates 
the various routing & congestion schemes SP, SPSQ and MACLCE perform 
about equally well, but when it comes to the critical regime, the control with 
MAC-distributed lowest-cost estimates yields by far the largest critical packet 
creation rate. Although more packets are present in the network, such a routing 
& congestion scheme is able to handle packet creation rates, exceeding the 
maximum rate obtained with the classical shortest-path routing by a factor 
of about 1.4. The inset of this Figure shows the number of active packets 
Active (t) for MACLCE at // = 0.014, indicated by the arrow. There is no linear 
dependence on time, which is a clear sign that the network is still operating 
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in the subcritical regime. 



Another goal for the new routing & congestion algorithm has been to reduce 
the pronounced tail in the distribution p(t e 2 e ) of the end-to-end time delay. 
Fig. 10 demonstrates that for p, = 0.0095, which is very close to the SP 
critical packet creation rate, the MACLCE and SPSQ distributions are about 
the same and, when compared to the SP distribution, come with a suppressed 
tail. Note, that log-scales have been used in Fig. 10. For larger packet creation 
rates, where the SP and SPSQ schemes are already in the supercritical regime, 
the routing & congestion control with MAC-distributed lowest-cost estimates 
results in rather flat distributions, which come with a relative sharp cutoff at 
larger end-to-end time delays. Of course, this cutoff increases with the network 
load. 

Compared to the SP routing significant changes can be observed in the distri- 
bution p(rii) for the single-node queue length; see Fig. 12. At /i = 0.0095 the 
SP distribution is a broad exponential (see also bottom of Fig. 4), whereas the 
MACLCE distribution is confined to basically rij < 3. For larger packet cre- 
ation rates the MACLCE distributions become bell-shaped. Their mean and 
variance increase with p. Good fits can be obtained with a two-parametric 
continuous Gamma distribution 

PgammaW = fT^^ 1 ^ ' ( 26 ) 

consult the inset Figure. For MACLCE-controlled networks close to p cnt this 
bell-shaped single-node queue-length distribution is a result of the flexible 
routing scheme, which adapts well to the current congestion state, and is key 
to their improved operational functionality. 

A direct consequence of the bell-shaped distributions p(rij) is that (nf(t)) pa 
( n i(t)) 2 - This then keeps the correlation function (15) close to one, even for 
small At. Thus with the packet creation rate approaching its critical limit, the 
single-node temporal correlations are expected to be drastically reduced. The 
simulation results illustrated in Fig. 11 confirm this view. 

4-3 Congestion control with memory-based adaptive routing 

So far the cost estimate Wifj of node % is updated according to (22) as soon as 
the neighboring node j G Mi MAC-reports its change of either Wij or Wjf. This 
immediate update might be too fast to be optimal. It could be wise to keep 
at least in parts some of the old cost estimate. Introducing a kind of memory 
parameter < v < 1, a proposition for a modified update rule would be 

W if j - v W ifJ + (l-is)[w ij + W jf ] . (27) 
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For v > a fraction of the old cost estimate is kept as a part of the new 
estimate. This modification includes a memory of formerly used routes that 
are only updated if significant changes in the network's congestion state have 
occurred. This approach, which is inspired by reinforcement learning [27], is 
known as Q-routing [29]. 

The simple extension (27) proved to cause a small but clearly measurable fur- 
ther improvement in network performance. As indicated in Fig. 9 the memory- 
based mMACLCE scheme with v = 0.65 increases the critical packet-creation 
rate a little further when compared to the instantaneous MACLCE scheme 
with v — 0. It turns out that v pa 0.65 is the optimal choice. As a function of v 
the critical packet creation rate first increases for values rising from v — to 
0.65, takes its maximum at v pa 0.65 and then decreases for values above. It 
is intuitive that in case of a strong memory [y ~ 1) the update rule collapses 
and only keeps very old and out-fashioned cost estimates, which are not suited 
to adapt to the always changing congestion state of the network. 



5 Conclusion and Outlook 

This Paper has focused on routing & congestion control in wireless multihop 
ad hoc communication networks. Simulations with random data traffic have 
been accompanied with analytic estimates, whenever possible. The focus has 
first been on shortest-path routing, to understand certain data traffic char- 
acteristics like end-to-end time delay and correlation time scales, and to find 
fingerprints of congestion once the network is operating close to its critical 
load. A scaling law has been found for the average end-to-end time delay with 
respect to network size, which also revealed a dependence on the underlying 
network topology. In a second step and going beyond shortest-path routing, 
a distributive routing & congestion control has been proposed, which couples 
the MAC- and routing layer of wireless multihop ad hoc communication. Before 
one-hop forwarding a packet, the sending as well as receiving node MAC-block 
their respective neighbors and distribute information about their congestion 
state and routing cost estimates, which the latter then use for updates. This 
distributive scheme turned out to be very efficient. Compared to shortest-path 
routing, the critical network load increased noticeably. Routes are constantly 
adapting to the prevailing congestion state of the network. With other words, 
routes selforganize themselves. 

The proposed prototype routing & congestion control needs of course fur- 
ther testing and extensions. Other than simple random data traffic has to be 
looked at, such as for example selfsimilar [30], self-organized-critical [31] and 
spatially localized. Congestion updates with different forms of cost metrics are 
important to investigate as well as the sparsity issue, i.e. which information 
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is important to be distributed to other nodes and which is negligible. At the 
end, the biggest challenge is yet to come, to turn provably good ideas into 
real-life-functioning implementations. This is where physics and engineering 
should meet again. 
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Fig. 1. Random geometric wireless multihop ad hoc graphs obtained with (left) 
const-P and (right) minimum-node-degree transmission power assignment. N = 100 
nodes have been randomly and homogeneously distributed onto a unit square. 
Solid/dotted links are bi-/unidirectional. 
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Fig. 2. Sample- and node-averaged end-to-end time delay t e 2 e (n) determined from 
generic data traffic simulations (symboled curves) and the analytic estimate us- 
ing Eqs. (2), (7), (10) and (11) (curves without symbols). The network size has 
been fixed to iV = 100. The two transmission power assignments are const-P (ver- 
tical crosses) with ^target = 24 and minimum-node-degree (rotated crosses) with 

krnin = 8. 
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Fig. 3. Distribution of the end-to-end time delay obtained from a generic data 
traffic simulation with fixed shortest-path routing on a typical const-P network 
with N = 100 nodes. (Top) fi = 0.005 well below and (bottom) // = 0.0095 close to 
the critical packet creation rate /i C rit- Best fits with an exponential and a log-normal 
distribution are also shown. The insets represent log-log plots. 
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Fig. 4. Distributions for (top) interarrival times, (middle) sending times and (bot- 
tom) queue lengths as observed at the most-critical node of a const-P network 
realization with N = 100. All shown packet creation rates belong to the subcriti- 
cal phase. The thin lines in (bottom) represent the expression (6), where according 
to (9) the in- and out-flux rate have been taken from (top) and (middle) as the 
reciprocal of the mean interarrival and sending times. 
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Fig. 5. Average end-to-end time delay as a function of fi/fJ> C rit for various sizes 
of (top) const-P and (bottom) minimum-node-degree networks. The lowest curve 
represents the curve collapse (14) with iVo = 200; the exponent 5 is shown in the 
inset figure. 
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Fig. 6. Single- node temporal correlation ri(At) for the most-critical node of a 
const-P reference network with N = 100, obtained from a simulation covering 
5 • 10 5 time steps. Different line types correspond to different packets creation rates, 
all below ^ cr i t = 0.0101. The inset shows the curve collapse (16) after appropriate 
rescaling. 
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Fig. 7. Time scales r co Q a p Se and T int as a function of the packet creation rate. The 
same const-P reference network with TV = 100 has been used as in the previous 
Figure. The results directly obtained from a data traffic simulation are shown with 
filled symbols. The curves with open symbols have been derived from Eq. (21) with 
in- and out-flux rates sampled from data traffic simulations. Note that the two time 
scales have been normalized such that T couapse / int = 1 for fi = 0.0095. 
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Fig. 8. Comparison of the rescaled correlation functions (rj(At)) 1 /^ of Fig. 6 with 
the analytic expression (21). For the latter, the in- and out-flux rates have been 
sampled from the same generic data traffic simulations, the same network realization 
and the same node, which have been used for the former. 
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Fig. 9. Average end-to-end time delay as a function of the packet creation 
rate for various routing & congestion controls: (SP) shortest-path, (SPSQ) short- 
est-path-shortest-queue, (MACLCE) MAC-distributed lowest-cost-estimate with 
v = 0, and (mMACLCE) memory-based MAC-distributed lowest-cost-estimate with 
v = 0.65. Respective generic data traffic simulations have been run on an identical 
const-P network realization of size N = 100. 
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Fig. 10. Distribution of the end-to-end time delay for various routing & congestion 
schemes and packet creation rates. For [i = 0.0095 the schemes shortest-path (SP), 
shortest-path-shortest-queue (SPSQ) and MAC-distributed-lowest-cost-estimates 
(MACLCE) are compared; for /x = 0.012 and 0.014 only the MACLCE scheme 
is shown. Generic data traffic simulations have been run on an identical const-P 
network realization of size N = 100. 
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Fig. 11. Single-node correlation function rj(Ai) for various routing & congestion 
controls and packet creation rates. Respective generic data traffic simulations have 
been run on an identical const-P network realization of size N = 100 and also the 
picked node has been the same for all cases. 
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Fig. 12. Single-node distribution p{rii) of the queue length for various routing & 
congestion controls and packet creation rates. Respective generic data traffic simu- 
lations have been run on an identical const- P network realization of size N = 100 
and also the picked node has been the same for all cases. For the MACLCE-curve 
with n = 0.0125 the inset illustrates a fit with the Gamma-distribution (26). 
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